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Foreword 

This Ethiopian Standard has been prepared under the direction of the Technical Committee for IVIilk and IVIilk 
Products (TC 25) and published by the Ethiopian Standards Agency (ESA). The standard is identical with ISO 22935-3 
:2009 Milk and milk products — Sensory analysis — Part 3 Guidance on a method for evaluation of compliance 
with product specifications for sensory properties by scoring published by the International Organization for Standardization 
ISO 2009. 
For the purpose of this Ethiopian Standard, the adopted text shall be modified as follows. 

• The phrase "International Standard" shall be read as "Ethiopian Standard"; and 

• A full stop (.) shall substitute comma (,) as decimal marker. 



ETHIOPIAN STANDARD ES ISO 22935-3:201 2 



Milk and milk products — Sensory analysis — 

Part 3: 

Guidance on a method for evaluation of compliance with 

product specifications for sensory properties by scoring 



1 Scope 

This part of ISO 229351 IDF 99 gives guidance on a general method for evaluation of compliance with product 
specifications for sensory properties based on sensory scoring and the use of a common nomenclature of 
terms. 

The method is especially applicable in process and quality control performed regularly on a larger number of 
samples and/or with some time pressure and/or with a limited number of expert assessors available. 

The results from the method may be part of product classification systems for domestic and international trade. 
Classification systems are not covered by this part of ISO 229351 IDF 99. 

2 Normative references 

The following referenced documents are indispensable for the application of this document. For dated 
references, only the edition cited applies. For undated references, the latest edition of the referenced 
document (including any amendments) applies. 

ISO 41 21 , Sensory analysis — Guidelines for tine use of quantitative response scales 

ISO 5492, Sensory analysis — Vocabulary 

ISO 5496, Sensory analysis — IVIetfiodology — Initiation and training of assessors in tine detection and 
recognition of odours 

ISO 6658, Sensory analysis — Metfiodology — General guidance 

ISO 8586-1 , Sensory analysis — General guidance for the selection, training and monitoring of assessors — 
Part 1: Selected assessors 

ISO 8586-2, Sensory analysis — General guidance for tine selection, training and monitoring of assessors — 
Part 2: Expert sensory assessors 

ISO 8589, Sensory analysis — General guidance for tine design of test rooms 

ISO 1 3300-1 , Sensory analysis — General guidance for tine staff of a sensory evaluation laboratory — Part 1: 
Staff responsibilities 

ISO 1 3300-2, Sensory analysis — General guidance for tine staff of a sensory evaluation laboratory — Part 2: 
Recruitment and training of panel leaders 

ISO/I EC 1 7025, General requirements for tine competence of testing and calibration laboratories 
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ISO 22935-1 1 IDF 99-1 , Milk and milk products — Sensory analysis — General guidance for tine recruitment, 
selection, training and monitoring of assessors 

ISO 22935-21 IDF 99-2, M/V/c and milk products — Sensory analysis — Recommended metliods for sensory 
evaluation 



3 Terms and definitions 

For the purposes of this document, the terms and definitions given in ISO 4121, ISO 5492, ISO 5496, 
ISO 6658, ISO 8586-1, ISO 8586-2, ISO 8589, ISO 22935-1 1 IDF 99-1 and the following apply. 

3.1 
property 

(sensory analysis of milk products) overall appearance, consistency or odour/flavour of a sample 



4 Principle 

Sensory properties of individual samples of milk and milk products are analysed under standardized 
conditions by a panel of expert milk and milk product assessors. Each assessor evaluates the samples 
independently of the other assessors and uses a discrete five point interval scale to estimate the magnitude of 
a possible deviation in a product from a pre-established sensory product specification. When the score of 
each assessor is 3 or lower, then the score is supplemented by common terms which describe the character 
of the sensory deviation. The mean values of the panel, supplemented with the representative terms when the 
mean values are lower than 3,6, gives the result of the method. 

5 General test requirements 

The method shall be used in conjunction with ISO 22935-1 1 IDF 99-1 and ISO 22935-21 IDF 99-2. Follow also 
the general guidance on the methodology of sensory analysis given in ISO 6658. When relevant, it is also 
recommended that the general requirements for the competence to carry out tests given in ISO/I EC 17025 
with supplemental documents specific for sensory testing laboratories (such as EA-4/09 1^1) be followed. 

5.1 Test room 

Conduct the sensory analysis in a special test room with standardized conditions which are monitored 
regularly when testing. See ISO 22935-21 IDF 99-2 and ISO 8589 for the characteristics of the room in which 
the tests are to be performed. 

5.2 Assessors 

Assessors shall be recruited, selected, trained and monitored to satisfy the criteria for expert milk and milk 
product assessors. See ISO 22935-1 1 IDF 99-1, ISO 8586-1, ISO 8586-2, and ISO 5496 for general guidance. 

5.3 Panel 

The number of assessors in the panel shall be at least three. See also ISO 22935-1 1 IDF 99-1 for additional 
requirements for assessors in the panel and ISO 22935-21 IDF 99-2 for general guidelines for the preparation 
of a panel. 

5.4 Panel leader 

A panel leader familiar with sensory evaluation of the products shall be responsible for the entire procedure 
and shall normally not participate in the panel. The panel leader may, however, be a panel member in regular 



©ESA 



ES ISO 22935-3:2012 



process or quality control situations (e.g. at processing dairy plants), if the number of assessors at the site is 
limited and the panel leader satisfies the criteria for expert milk and milk product assessors. See also 
ISO 22935-21 IDF 99-2, ISO 13300-1, and ISO 13300-2 for additional requirements for the panel leader. 

5.5 Documents 

Necessary documents for the sensory evaluation of the various products shall be available. The documents 
shall be standardized and common to all comparable sensory evaluations utilizing this method, e.g. in a 
specific process or quality control in a company or region. 

5.5.1 Specific methods for specific milk and milk products 

Specific methods shall supplement this part of ISO 229351 IDF 99 and shall specify in detail necessary 
apparatus, sampling procedure, the preparation of samples for sensory analysis, and the sensory evaluation 
of specific milk and milk products. See also ISO 22935-21 IDF 99-2 for recommended methods. 

5.5.2 Product specifications 

A pre-established sensory product specification shall describe the sensory requirements to be fulfilled to 
establish the fitness of the product for purpose in a specific market. For example, the description may be a 
sensory profile (ISO 13299 I^l) obtained by profiling products that have been found fit for purpose by 
consumer testing. A control sample may, if available, supplement the sensory product specification. 

5.5.3 Nomenclature of terms 

A nomenclature of terms shall include all terms relevant for objectively describing the character of sensory 
deviations in a specific milk or milk product from the description in the sensory product specification. See also 
ISO 22935-21 IDF 99-2 for recommended terms for specific milk and milk products. 

In some cases, where the character of the deviation is described by a term which is also a part of the sensory 
product specification, and it is difficult to find an alternative objective description which covers the actual 
deviation, it may be necessary to add "low intensity" or "high intensity" to the term in the nomenclature of the 
specific product (e.g. "low intensity of sweetness" or "high intensity of sweetness"). 

The nomenclature may include guidelines for the assessors to give information regarding the significance of 
the specific terms, and their combinations, for estimating the magnitude of the deviation from the sensory 
product specification. 



6 Apparatus 

Select the apparatus according to the nature of the milk or milk products to be analysed. The selected 
apparatus shall not affect the test samples or the assessors in an undesired manner and the functioning and 
use shall, when relevant, be monitored regularly when testing. See also ISO 22935-21 IDF 99-2 for 
recommended apparatus for sensory evaluation of specific milk and milk products. 

7 Sampling 

Sampling is not part of the method specified in this part of ISO 229351 IDF 99. Unless special requirements 
are given for the sampling, a recommended sampling method is given in ISO 707 1 IDF 50 fl (see also 
ISO 22935-2 1 IDF 99-2 for sampling of specific milk and milk products). 

The laboratory shall receive a test sample which is truly representative and which has not been damaged or 
changed during sampling, transport or storage. 
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Precautions, therefore, shall be taken during sampling, transportation, and storage of the samples so that the 
sensory properties are not affected by these factors. 

8 Preparation of test samples 

Prepare test samples for assessment as specified in ISO 22935-21 IDF 99-2 for individual milk and milk 
products. 

During the preparation of test samples, take precautions to ensure that the sensory properties are not affected 
in an undesired manner. 

Arrange the assessment so that the identity of each sample to be assessed is not known to the assessors. 

Take precautions to ensure that assessors are not influenced by the size and shape of the samples or by the 
mode of presentation. 



9 Procedures 

9.1 Evaluate the overall appearance, the overall consistency, and/or the overall odour/flavour of each test 
sample separately. See ISO 22935-21 IDF 99-2 for recommended methods for the sensory evaluation of 
specific milk and milk products. 

9.2 In scoring each property, use the numerical discrete interval scale presented in Table 1, which 
represents the magnitude of the deviation in a product from the pre-established sensory specification. 

Table 1 — The numerical discrete interval scale giving the magnitude of deviation in the scoring 



Points 


Verbal description 


5 


No deviation from the pre-established sensory specification 


4 


Minimal deviation from the pre-established sensory specification 


3 


Noticeable deviation from the pre-established sensory specification 


2 


Considerable deviation from the pre-established sensory specification 


1 


Very considerable deviation from the pre-established sensory specification 



9.3 Each of the assessors shall score the test samples of a specific milk or milk product in a random order. 
In regular process or quality control situations (e.g. at processing dairy plants) it is, however, sufficient that the 
panel as a whole score the test samples of a specific milk or milk product in a random order. 

9.4 Serve highly flavoured types of specific milk and milk products and/or products with a high fat content 
after less highly flavoured products and/or products with lower fat content. 

9.5 Adjust the maximum number of test samples for each assessment to the type of product to be assessed, 
so that the assessment is carried out consistently for each sample. If necessary, carry out the assessment at 
adequate intervals. 

9.6 Present the test samples in such a way that assessors cannot mix them up. 

9.7 Instruct assessors to do the technical performance of the sensory evaluation in an appropriate and 
repeatable way (size of the sample in the mouth, time of chewing, etc.). 

9.8 Use a suitable cleanser (e.g. mouth rinse with pure, room temperature water) to prevent carry-over of 
any stimuli that might affect the score of the next sample. 
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9.9 In order to adjust and coordinate assessors, assess at least two calibration samples for each type of 
product and discuss the results obtained before starting the assessment of a product. Preferably, one of the 
calibration samples shall be expected to conform to the sensory specification (a control sample). Calibration 
samples shall be available during the assessment. 

9.10 Individual assessors shall analyse test samples independently of each other, without 
intercommunication, and only utilize whole points. 

9.11 If an assessor scores a property 3 points or lower, a description of the deviation shall be given. In doing 
so, the assessor shall use the nomenclature of terms (5.5.3) for the specific milk or milk product and list the 
terms according to the significance of the magnitude of deviation from the product specification. 

9.12 When the scoring by the assessors for a particular property is spread over adjacent points only, the 
mean value for the panel shall be calculated to one decimal place. 

9.13 If the differences between the individual scoring for a property are wider than adjacent points (for 
example wider than 3 and 4), perform a reassessment of this property. Individual assessors shall reassess 
independently of each other, preferably without knowing which test sample and property they are reassessing. 
The results from the reassessment are final and the mean value for the panel shall be calculated to one 
decimal place based on these results. 

9.14 If the mean value for the panel is lower than 3,6 for a property, list the description of the deviation 
according to the significance of the magnitude of deviation from the product specification. Assessors in the 
panel may, if necessary, discuss and agree on the terms to be stated. 

9.15 The mean value of the panel for each property, supplemented with the representative term(s) when the 
mean value is lower than 3,6, gives the result of the method. 



10 Precision 

This part of ISO 229351 IDF 99 gives guidance on a method which shall be supplemented with specific 
methods for different specific milk and milk products (5.5.1), different product specifications made by different 
companies, region, countries etc. for different specific markets (5.5.2), and a nomenclature of terms for the 
specific milk and milk products (5.5.3). 

This leads to a very broad range of parameter combinations which have to be covered by a large and very 
expensive interlaboratory test to give any relevance to precision figures (repeatability and reproducibility) for 
users of this part of ISO 229351 IDF 99. For that reason, it was not found appropriate to arrange a general 
interlaboratory test for this method. 

Instead it is recommended that different companies, regions, countries, etc. using this method and having 
specified the above mentioned supplements for their own specific products, arrange an interlaboratory test 
carried out in accordance with ISO 5725-1 I^] and ISO 5725-2 1^1, relevant for their products and their use of 
the method, to find their own precision figures. 



1 1 Test report 

The test report shall contain at least the following information: 

a) all information necessary for the complete identification of the test sample; 

b) the sampling method used, if known; 

c) the test method used, with reference to this part of ISO 22935 1 IDF 99; 
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d) all operating details not specified in this part of ISO 229351 IDF 99, or regarded as optional, together with 
details of any incidents which may have influenced the test result(s) — of special interest are: 

1 ) the number of assessors, 

2) whether the panel leader participated in the panel as an assessor, 

3) type of product specifications (e.g. company, describing sensory requirements for which market), 

4) whether the identities of the samples were known to the assessors, 

5) whether each of the assessors, or the panel scored the test samples in a random order, 

6) any information and any specific recommendations given to the assessors in connection with the test, 

7) the location, date and name of the panel leader; 

e) the test result(s) obtained and, if the repeatability has been checked, the final quoted result obtained as a 
statement of the estimated uncertainty of measurement; 

f) when relevant, any supplementary information given in ISO/I EC 17025. 
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More Information ? 
Contact us at the following address. 

The Head Office of ESA is at Addis Ababa. 

Son- 646 06 85, Oil- 646 05 65 
1^011-646 08 80 
IHI 2310 Addis Ababa, Ethiopia 
E-mail: info@ethiostandards. org. 
Website: www. ethiostandards. org 
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